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I. 



INTRODUCTION 



A. COMBAT MODELLING AS AN ANALYTICAL TOOL 

Mathematical combat modelling is becoming increasingly 
important throughout the services as a tool for assistance 
in decision-making on new weapons systems and force levels 
and for gaining insights to their applications in specific 
military scenarios. It is of interest to continue research 
in this area to develop models which are realistic to a given 
combat situation and hence useful to the decision-maker and 
which are mathematically tractable. Current models in use 
employ either Monte Carlo simulation of combat as used in 
DYNTACS (Dynamic Tactical Simulator), or analytic methods as 
found in the Bonder IUA (Individual Unit Action) model. Ex- 
ploration of the effects of various decision variables avail- 
able to the combatants becomes extremely important when 
attempting to incorporate sound military tactics into any 
model under consideration. These decision variables could 
be explored heuristically or by applying optimization theory 
to each specific model. It is the intent of this thesis to 
examine an idealized question of optimal time sequential 
tactical decision-making through the application of optimi- 
zation theory. 
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B. HISTORY OF THE LANCHESTER MODELS 



The basis of the deterministic models used today are the 
equations formulated by Lanchester [6] in 1914 to describe 
the attrition process between two homogeneous combat forces: 

= -ay and ^ = -bx where a, b are Lanchester attrition 
rates for the forces X and Y and x(t), y(t) are the force 
levels at time t. Koopman [7] formulated a stochastic ex- 
tension to the purely deterministic model by incorporating 
state probabilities; i.e., the probability that at time t 
the force levels are x(t) and y(t). This extension will be 
referred to as the Lanchester stochastic process. This 
stochastic reformulation became a definite step forward in 
the theory of modelling, since it allows casualties to occur 
randomly over time. 

• Isbell and Marlow [2] were among the first to apply op- 
timal time sequential decision-making to Lanchester models 
of combat. In particular, they developed a general fire 
programming problem for target allocation for combat among 
heterogeneous forces and employed techniques of Isaacs [1] 
in their solution. Later, Taylor [9] used a different ap- 
proach (modern optimal control theory) to develop a more 
complete solution and presented a general solution algorithm 
for the basic problem. Specifically, the decision variable 
was the commander's allocation of fire in the case of com- 
bat between one homogeneous Y force against an X force of 
two homogeneous types in the deterministic Lanchester model 
formulation of the situation. Although this is the simplest 
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of all possible cases of this type, the general solution is 
quite complicated. Nonetheless, it does give useful insights 
to the problem of allocation of fire, and is a step forward 
in developing solutions for more complex situations. 

Although the stochastic version of the Isbell-Marlow 
problem would theoretically be a better model since the ran- 
dom nature of combat attrition is considered, one might 
question whether or not similar results would be obtained; 
i.e. would the allocation of fire follow the same pattern as 
in the deterministic case? This question becomes highly 
relevent since to obtain a general analytic solution to the 
stochastic version is exceedingly complex and has only been 
done in a few specific cases. Powers [8] has made a com- 
parison of these two versions for the prescribed duration 
battle and found that strategies were essentially the same 
as in the deterministic model, although in this case the 
comparison was awkward to make. This thesis will compare 
optimal strategies derived from the stochastic and determin- 
istic versions of the Isbell-Marlow problem in the case of a 
fight to the finish. Hopefully, some insight will be gained 
into the basic structure of the stochastic model. 

The next section of this thesis will review the deter- 
ministic optimization problem and the implications of its 
solution. Then a discussion of the stochastic version will 
follow with a presentation of the conditions for optimality. 
Finally, numerical results for specific cases of the sto- 
chastic version will be compared with the deterministic model. 



10 



II. PROBLEM STATEMENT 



A. DETERMINISTIC ALLOCATION OF FIRE MODEL 

The case under consideration'*' has the commander of a 
homogeneous Y force desiring to maximize the net worth of 
survivors in a battle between a heterogeneous X force of two 
homogeneous types (Xi and X 2 ). A linear cardinal utility is 
imposed on the survivors as the objective function, and the 
decision variable <f) ( t ) is the proportion of Y fire directed 
at the Xi force at time t. The situation is diagrammed in 




Figure 1. Allocation of Fire Between Forces 



A concise summary of the problem and its complete solu- 
tion is given in Reference 10. 
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The optimal control problem for a fight to the finish is 
formally stated as 

Maximize {ry(T)-px j (T)-qx 2 (T) } 

4>(t) 

V 

Subject to: L = -<J>(t)aiy 

dt 

dX2 

dt~ = -{ l-4> ( t ) }a 2 y 

= -bjXj - b 2 x 2 (1) 

with constraints 
Xi, x 2 , y > 0 

0 £ t £ T , T unspecified 
0 £ 4»(t) £ 1 
and initial conditions 

xi(0) = x? , x 2 (0) = xl , y(0) = y 0 

and stopping rule 

either 1) y(T) =0 (X force wins) 

or 2) x i ( T ) = 0 and x 2 (T) =0 (Y force wins) 

Note that a. is the attrition rate of the X. force due 

l l 

to Y's fire, while b. is the attrition rate of the Y force 

’ l 

due to X.'s fire. Hence the factor a.b. can be interpreted 
l ii 

as the rate of destruction of X^ ' s kill capability against 
Y. Also, since p and q are measures- of the "worth" of the 
Xi and X 2 survivors, aip is a measure of the rate of 
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destruction of an Xi combatant's value to Y and a 2 q the X 2 
combatant's value to Y. These are the factors upon which 
the optimal fire distribution policy, call it <{>*, depends . 

It has been shown [9] that <j>* must be either zero or one ex- 
cept for at most one point in time. 

Simply stated, there are two cases in which the Y force 
will always fire at Xj until complete annihilation of the Xi 
force then switch fire to X 2 . If Xi(T) = x 2 (T) = 0 and 
ait>i>a 2 b 2 , then <£* = 1.0 v Xi>0. Also, if aibi>a 2 b 2 and 
ajp^a 2 q, then <}>* = 1.0 V Xj>0. In the first case if Y wins, 
he will always fire at the force whose kill capability he 
can destroy the fastest. In the second case, he will always 
fire at the force whose kill capability and survivor "worth" 
he can destroy faster. If the above conditions do not hold, 
the optimal fire distribution policy may shift during the 
course of battle, and the timing of this shift may be com- 
plex to describe. 

B. STOCHASTIC ALLOCATION OF FIRE MODEL 

1. Formal Model 

If, in the above deterministic Lanchester-type formu- 
lation, the combat attrition process is considered to be 
Markovian, then the resulting stochastic optimal control 
problem may be stated as: 
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Maximize { E [ rN(T)-pMi (T)-qM 2 (T) ] } 
0</|>£l 



( 2 ) 



Subject to: random occurrence of casualties as a 

continuous parameter Markov Chain with 
transition probabilities corresponding 
to the deterministic Lanchester process 
( 1 ) 

with constraints 

N(t), M i ( t ) , M 2 (t) > 0 
0 £ t £ T, T unspecified 
0 < ^ < 1 

and initial conditions 

P{N( O)=n 0 }=1, P{M ! ( 0)=mj }=1 , P{M 2 ( 0)=ra2 }-l 

and stopping rule 

either 1) n(T)=0 (X force wins) 

or 2) m 1 (T)=0 and m 2 (T)=0 (Y force wins) 

N(t), Mj(t), and M 2 (t) are random variables specify- 
ing force levels of the Y, X x , and X 2 forces respectively, 
E[*] is mathematical expectation,, and tp is again the propor- 
tion of Y firers directing their fire at the Xi force at 
time t. 

For the reader's convenience, some probabilistic 
aspects of Lanchester combat will be reviewed (see [3], [10] 

for more formal analysis) before the dynamic programming de- 
velopment of the fundamental functional equation for the 
stochastic control problem. Since this thesis is concerned 
with the fight to the finish (see stopping rule for (2) 
above), analysis by the author will then be presented which 
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logically connects this situation to the one developed by 
Powers and Taylor [8] for the prescribed duration battle. 

2. Underlying Poisson Process 

The occurrence of casualties forms a Poisson Process 
with the attrition rates associated with the rate of the 
process. Assuming independent and stationary increments and 
the probability of more than one casualty occurring in At to 
be negligible, the event probabilities are developed: 

Define : 

CX^ - Event of an casualty in At; i=l,2 
CY = Event of a Y casualty in At 
C - Event of a casualty in At 

and note that CXi , CX 2 , CY are mutually exclusive and 
they are collectively exhaustive of the event C. 

Then : 

P(CXi ) = cf> a i nAt 
P(CX 2 ) = (l-4>)a2nAt 
P(CY) = (b imi +b2m2 )At 

P(C) = 4 , ainAt + (l-(J))a2nAt+(bimi+b2m2 )At 
For the later dynamic programming problem to be de- 
veloped it is necessary to have the probability of a casualty 
being from a particular force, conditioned on a casualty 
occurring. Hence, by Bayes rule: 
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ai n 



P(CXj |C) 



(^ajn + Cl-tJ) )a 2 n+b 1 m 1 +b 2 m 2 



P(CX 2 |C) 



(l-(j>)a ? n 

4>aj n+( 1-(J> )a 2 n+b 1 m 1 +b 2 m 2 



P(CY | C) 



b,m, +b 7 m ? 

(jia) n+( 1-(J) )a 2 n+b 1 m 1 +b 2 m 2 



( 3 ) 



3. Optimal Control/Dynamic Programming Problem 

The problem as stated in equation (2) readily be- 
comes a dynamic programming problem when the state of the 
system is taken as the three force levels at any arbitrary 
time t and a return function is associated with each possi- 
ble force level. Define: 

System State = { (m x , m 2 , n ) | (Km^m J , 0<m 2 <m^ , (Knjcn 0 } 
Expected Return = R( <j> ; m t , m 2 , n ) = E [ rN(T )-pMj (T)-qM 2 (T) ] 

Optimal Expected Return = W(m 1 ,m 2 ,n) = Max{R(<J> ;m x ,m 2 , n) } 

<j)G$ 

*1 O n i 

Control Variable = <j> c $ = {0, — , — ,1} 

T l, nn n 

Viewing the system in "backwards time", there are 
exactly three ways any particular state (m 1 ,m 2 ,n) can be 
realized through the random occurrence of , casualties . The 
dynamic system is described diagrammatically in Figure 2. 

The optimal expected return for any state (mi,m 2 ,n) 
is thus the expected value of the optimal expected return 
from the three previous possible states when maximized over 
the control variable <f> . Mathematically, 



W(mi,m 2 ,n) = Max {W(m! -1 , m 2 , n )P(CX i /C)+W(mi ,m 2 -l , n )P(CX 2 /C) 
4>e$ 

+W(m! ,m 2 ,n-l)P(CY/C)} . 
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Figure 2. System Dynamics of Stochastic Allocation of Fire Model 



Utilizing the probabilities previously developed (3), the 
fundamental functional equation for the stochastic allocation 
of fire model is obtained: 



Wfm m, m = Max i ^±1 nff i + i ) a 2 nW 2 + (b 1 m t +b ? m 2 )W 3 l 
( 1 ^ ^ ?a7 n+( l-<j) )a 2 n+b 1 mi+b 2 m 2 



The boundary conditions are: 



1) 


W(0, 0, n) = rn 


P 

II 

o 

M 


. . , n o 


2) 


W(m!,m 2 ,0) = -pm 1 -qm 2 


3 

>-> 

II 

o 

M 


™ o 

. . , m i 






m 2 = 0,1,. 


OCM 

E 



(4) 



For notational simplicity, it is useful to define 
the following terms before developing the optimality condi- 
tions for the selection of <j> : 



W =W(m 1 ,m 2 ,n) 

Wj = WCmj-l ,m 2 , n) 
W 2 = W(m x ,m 2 -l, n) 
W 3 = W(m x ,m 2 , n-1) 



R(4>) - 



cj)a 1 nW 1 + (l-<{))a 2 nW 2 + (bim 1 +b 2 m 2 )W 3 
4>ain+( 1-<J> )a 2 n+biKt! +b 2 m 2 



Rearranging terms of the objective function, a ratio 
of two linear functions of <j> is obtained (momentarily assum- 
ing <j> to be continuous over the closed interval [0,1]): 

u/an _ 4>(a 1 nWi-a 2 nW 2 ) + (b 1 m 1 +b 2 m 2 )W 3 +a 2 nW 2 
R( <p ) - 

4>(a 1 n-a 2 n)+b 1 m 1 +b 2 m 2 +a 2 n 
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Since R(4> ) is such a ratio, it follows 



2 



that 



R’(4>) 



>0^ A>B 
=0 <?$> A=B 
<0 A<B 



where 

A = (a 1 W 1 -a 2 W 2 ) (bi mj +b 2 m 2 +a 2 n) 

B = (a] -a 2 ) [ ( b ! m j +b 2 m 2 )W 3 +a 2 nW 2 ] 

Thus, the optimality conditions for <J> and optimal return for 
the stochastic allocation of fire model are 



W = Max (R(4>)} 

<p£$ 



■ R( 4>— 1 ) A>B 

R(4> ’ ) <=> A=B 

R((J) = 0) ^ A<B 



(4)' arbitrary) 

(5) 



There is no known general solution to this optimal 
control/dynamic programming problem. However, for any set 
of input parameters ( a i , a 2 , b i , b 2 , p , q , r ) , a solution may be 
built up throughout the set of possible states. Optimal re- 
turns for the base cases may be explicitly found from the 
boundary conditions, and returns for succeeding states found 
in turn. However, these may only be computed in a particu- 
lar order, since to find the optimal expected return for any 



2 R(40 



a4>+b 

c<}>+d 



R’ (40 



R' (40 




<=> ad>bc 
<=> ad=bc 
<=> ad<bc 



ad-bc 
(ccj)+d) 2 
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(mi,m 2 ,n) state, the optimal expected returns must be known 
for the three previous states (m 1 -l,m 2 ,n), (m 1 ,m 2 -l,n), and 

(m 1 ,m 2 ,n-l). (See Appendix A for the admissible order of 
states) . 

The fundamental equation (4) developed, here may be 

obtained from the fundamental functional equation derived 

3 

for the prescribed duration battle by taking the maximum 
length of the battle to be very large; i.e. considering the 
steady state form of optimal return when the time derivative 
of the return vanishes: 



0 = (bimi+b 2 m 2 )[W 3 -W]+ nMax [ <f>ai (W 1 -W) + (l-<j) )a 2 n(W 2 -W) ] 

<J> 

Placing all terms within the Max operator and rearranging 
yields 

Max{<J>ai nWx + (l-(}) )a 2 nW 2 + (b 1 m 1 +b 2 m 2 )W 3 - [({laj n+(l-4i )a 2 n 

<P 

+b 1 m 1 +b 2 m 2 ] W} = 0 

Factoring the coefficient of W gives 



Max{D( <j) ) [ 
< P 



<fi 3. i n 

DU) 



Wi 



+ 



( 1~4> )a 2 n .,, 

D(<P) 



2 



+ (b.in,+b,m,) . wi) - 0 

!>(<}> ) 



where D(<j>) = (fiaj n+( l-(}) )a 2 n+b 1 m 1 +b 2 m 2 



Since D(<j>) > 0 V 4> , ai , a 2 ,mi ,m 2 , n under consideration it fol- 

4 

lows that 



See p. 26-28 of Reference 8. 

4 Max{D(<j>)f (<}>)} =0 <=» (1)V<}>, D((j))f((t)) £ 0 and 

<P 

(2) 3 <P D(<p)f (4>)=0 For D(<J>) > 0, (1 ) V <p , f (<p ) £ 0 and 

(2) 3 (j) >: f (4>) = 0 <^> Max{ f ( 4> ) ) = 0 

4 > 
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Ma X { 4>ain ff 1 + U-f )a 2 n (bimi+b 2 m 2 ) _ w} = 0 

MaX1 D(4>) Wl DtT) W D ( <J> ) Wa W ' 0 



=- W = MaW 1 n W ) a 2 n w a. (b 1 m 1 +b 2 m 2 ) , 

J X TO 1 ~vW — 2 — DT?1 3 ' 

This is readily recognizable as the fundamental equation (4) 
for the fight to the finish. 
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III. COMPUTER ANALYSIS 



A . GENERAL 

Output information required for analyzing the stochastic 
model consists of three elements: the state of the system, 
its associated optimal expected return, and its optimal fire 
distribution policy, tabulated over all possible states for 
a given initial force level. With this information, a di- 
rect comparison with the deterministic model output of the 
allocation policy and return for each state is made possible. 
The comparison can be made easily by inspection whenever 
aibi > a 2 b 2 and aip 2l a 2 q, since the deterministic model so- 
lution is always to fire at Xi (4>*=1) when Xi > 0. Also, 
when aibi > a 2 b 2 and aip < a 2 q, the deterministic solution 
remains the same if Y wins. Conditions that guarantee that 
Y wins are readily determined for the deterministic problem, 
but in the stochastic model whether or not Y wins is proba- 
bilistic. Thus Y's decision may be significantly state de- 
pendent and he must continually evaluate his policy at each 
stage by comparing the tradeoff between his rate of destruc- 
tion of each X force's kill capability and his value of the 
"worth" of each X force to him as well as the value he places 
on his own forces. The underlying optimal fire distribution 
policy is tractable in this case, but highly complex. 
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B. PROGRAMMING 



For possible future applications, the computer program 
is listed at the end of this thesis. Since the return for 
any possible state is a function of the returns for the 
three previous possible states, the structural key is the 
ordering of admissible states. Hence this became the basic 
program with the optimal return and allocation policy for 
each state being computed in a subroutine. 

Several manual checks were made to verify the program 

5 

output. Admissible ordering of states previously tabulated 
proved to be in error; Appendix A is the corrected ordering 
for the general case. This ordering has been verified by 
manual tabulation of all possible states through several 
different force levels. Output from the algorithm itself 
was also manually verified through random selection of ex- 
amples from five specific force level categories where W and 
<f>* are computed by different methods. Only one category in- 
volves the computation of W and <j>* by the method presented 
in section IIB3; in all other cases <j>* is trivially zero or 
one and W is easily computed once this known. Appendix B 
lists the five categories and computations used by the com- 
puter. Printing of output is restricted only to those 
states with positive components due to the trivial alloca- 
tion policies of those with zero components. The initial 
force levels for Xi, X 2 , and Y are required for program 



See p. 36 in Reference 8. 
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set-up. Given a desired initial force level of m° , in®, and 
n 0 , the expected return array must be dimensioned (m°+l) * 
(m 2 +l) x(n 0 +l) and the upper value of the second DO-Loop 
must be no* The program is designed for battles where 
m° -m® -n o * 



C . INPUT PARAMETERS 

Input required for the program consists of values for ai , 
a 2 ,b x ,b 2 ,P,q, r,m° ,m° , and n 0 * Nineteen runs were made with 
various values for these parameters to allow comparison with 
the deterministic solution in Reference 9. The values were 
selected in order to represent the several tradeoffs upon 
which the Y force commander must make a judgment before 
allocating fire. Major factors influencing his decision in 
the deterministic model are: 

1) Rate of destruction of Xi kill capability versus 
X 2 kill capability, measured by the ratio R = a * 

2) Rate of destruction of Xj "worth" to Y versus X 2 

"worth to Y, measured by the ratio 6 = a — . 

a 2 q 

Output from the stochastic model shows that, in addition to 
the above, the Y commander should also take into account how 
dangerous the X forces are relative to him (measured by bi 
and b 2 ) and how much he values his survivors (measured by r). 

The system was analyzed using initial force levels of 
ten for the Xj , X 2 , and Y forces. In all cases, R is greater 
than one; R less than one would give a "mirror image” result. 
The parameter 6 fluctuates about one in varying degrees and 
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r ranges from one to one hundred thousand. The parameter 
sets and major decision factors are listed in Table I. Sets 
discussed in the next section are outlined in the table, and 
portions of each set's output is listed after Appendix B. 

D. ANALYSIS OF OUTPUT 

The major purpose of this thesis was to provide a comput- 
er program for solving the stochastic allocation model to 
give a means of comparison with the deterministic model. 
Significant implications were obtained by selecting param- 
eter sets 1,7,8,9,10,11, and 12 as a basis for comparison. 

In each of these sets R>1 and 6>1, so that the deterministic 
solution is always 4>*=1.0. The output from the stochastic 
model has shown that, even when the two conditions above 
hold, the Y commander should consider several other variables 
and their interactions before deciding upon which force to 
direct his fire. It is emphasized that the results dis- 
cussed below are based upon a logical intuition derived from 
a physical interpretation of the various input parameters. 

The optimal allocation policy <}>*=1.0 was obtained for 
all force levels with the input of parameter set one. Note 
that Y is twice as effective against the Xi force as he is 
against the X 2 force, and that a survivor's "worth" for each 
force is weighted the same. This result also follows in the 
deterministic model. 

Parameter sets 7,8,9,10,11, and 12 utilize, between each 
set, the same attrition rate coefficients and the same value 
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Data 
Set No. 






Parameters ■ 






— Determii 
Decision 


listic 1 

Factors 


a i 


a 2 


q 


r 


bi 


b 2 


p 


R 


6 




1. 


2 


i 


1 


1 


1 


l 


i 


2.0 


2.0 


2. 


2 


i 


1 


1 


1 


5 


100 


2.0 


0.4 


3. 


2 


i 


1 


1 


1 


10 


1 


2.0 


0.2 


4. 


2 


i 


1 


1 


1 


10 


10 


2.0 


0.2 


5. 


2 


i 


1 


1 


1 


10 


100 


2.0 


0.2 


6. 


2 


i 


1 


1 


1 


100 


1 


2.0 


0.02 


7. 


11 


i 


1 


10 


1 


1 


1 


1.1 


11.0 


8. 


11 


i 


1 


10 


1 


1 


10 


1.1 


11.0 


9. 


11 


i 


1 


10 


1 


1 


100 


1.1 


11.0 


10. 


11 


i 


1 


10 


1 


1 


1000 


1.1 


11.0 


11. 


11 


i 


1 


10 


1 


1 


10000 


1.1 


11.0 


12. 


11 


i 


1 


10 


1 


1 


100000 


1.1 


11.0 


13. 


11 


i 


1 


10 


1 


10 


1 


1.1 


l.i 


14. 


11 


i 


1 


10 


1 


20 


1 


1.1 


0.55 


15. 


11 


i 


1 


10 


1 


20 


10 


1.1 


0.55 


16. 


11 


i 


1 


10 


1 


20 


100 


1.1 


0.55 


17. 


11 


i 


1 


10 


1 


100 


1 


1.1 


0.11 


18. 


11 


i 


1 


10 


1 


100 


10 


1.1 


0.11 


19. 


11 


i 


1 


10 


1 


100 


100 


1.1 


0.11 



Table I . 



Input Parameters and Decision Factors 



placed upon the Xj and X 2 survivors. The only change occur- 
ring is the value Y placed upon his own survivors, which in- 
creases by a factor of ten through each set. The attrition 
rate coefficients were selected to represent two different 
concepts. When viewed individually, the coefficients repre- 
sent a marked difference in effectiveness of individual fire, 
but when viewed as products (a^b^) they reflect almost equal 
(R=l.l) rates of destruction of kill capability. Tactically 
considering the Y force as being attacked by two X forces, 
Figure 3 represents the situation as viewed by the Y com- 
mander with his interpretation of the factors involved. 

Constant throughout this situation are the facts that Y 
can destroy the X 2 kill capability almost as fast as Xi's, 
while an X 2 element is individually much more dangerous to 
Y than an Xj element. The results tend to show that, as 
long as the Y force has a "good" chance surviving, his fire 
will be directed against the Xj force which he can destroy 
faster. However, when his survivability is threatened, fire 
will be shifted to the more dangerous X 2 force. Finally, it 
appears that when destruction of the Y force is inevitable 
(Y has a very low force level compared to X) , Y will again 
shift fire to the Xj force to destroy as many of the enemy 
as he can before he himself is destroyed. Throughout this 
situation, as Y places more value upon his own survivors (an 
increase in r), he will direct fire more frequently to the 
more dangerous X force. Reinforcing this is the observa- 
tion that for these selected parameter sets, Vr' < r, 
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Figure 3. Parameter Input Interpretation 
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<t>*=1.0 at r =><{>*=1.0 at r' for a given force level, but the 
reverse implication does not hold. 

Tables II and III depict the phenomena .discussed above. 
Within each table, the probability of Y surviving is lowered 
as the Y force level decreases. Table entries are <p* , the 
optimal allocation of fire for the corresponding force lev- 
els and value Y places on his survivors. Figures were taken 
from the output in data sets 7,8,9,10,11, and 12 going from 
left to right in the tables. 
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Force Level 


1 


10 


Value 


of Y 


Survivor = r 


100,000 


mi 


m 2 


n 


100 


1,000 


10,000 


10 


2 


5 


1 


1 


0 


0 


0 


0 


10 


2 


4 


1 


1 


0 


0 


0 


0 


10 


2 


3 


1 


1 


0 


0 


•0 


0 


10 


2 


2 


1 


1 


1 


0 


0 


0 


10 


2 


1 


1 


1 


1 


1 


1 


0 



Table II 

Allocation of Fire When Y Survivability Is Seriously Threatened. 



Force Level 


1 


10 


Value of Y Survivor = r 


100,000 


mi 


m 2 


n 


100 


1,000 


10,000 


1 


i 


10 


1 


1 


1 


1 


1 


1 


1 


i 


9 


1 


1 


1 


1 


1 


1 


1 


i 


8 


1 


1 


1 


1 


1 


1 


1 


i 


7 


1 


1 


1 


1 


1 


1 


1 


i 


6 


1 


1 


0 


0 


0 


0 


1 


i 


5 


1 


0 


0 


0 


0 


0 












Table 


III 






Allocation of Fire 


When 


Y Survivability 


Is Almost 


Certain . 
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IV. CONCLUSIONS 



The purpose of this thesis was to make a comparison be- 
tween an optimal time-sequential fire distribution policy 
based upon a deterministic attrition mechanism and one based 
upon a stochastic process. This was done for the simplest 
possible fire distribution problem: a homogeneous Y force in 
Lanchester combat against a heterogeneous X force of two 
types. The optimal time-sequential fire distribution policy 
was determined for both the deterministic and stochastic op- 
timal control problems, and the results were compared. The 
specific comparison made indicated that even in the simplest 
case, the deterministic model nowhere reflects the many fac- 
tors considered in the stochastic model in determining the 
optimal allocation of fire. Even when the deterministic 
model tends to be simplistic, the stochastic version is ap- 
parently highly complex with interactions amony many vari- 
ables determining the optimal solution. Future work remains 
to be done on determining the true functional dependence of 
the optimal fire distribution policy for a stochastic attri- 
tion mechanism. 
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APPENDIX A 



GENERAL CASE FOR ADMISSIBLE ORDER OF COMPUTING OPTIMAL 

EXPECTED VALUE FUNCTIONS 

The ordering is listed for the condition that mi=m 2 =n° . 



The entire 


sequence 


must be followed 


for 


each i 


in the 


cession 


i=l 


, 2 , . . . , n 


. Numbers to the 


left 


of a 


section 


identify the corresponding DO-Loop in 


the 


main 


computer 


gram. 
















m l 


ra 2 


n 


mi 


m 2 


n 
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0 


0 


0 


1 


i 




0 


i 


0 


0 


2 


i 




0 


0 


. 500 


• 


* 


• 










0 


i-1 


i 




i 


1 


0 
















0 


i 


i 


200 


i 


2 


0 










• 


* 


j 


i 


0 


i 




i 


i-1 


0 


i 


0 


2 




i 


i 


0 600 


• 


• 


• 










i 


0 


i-1 




2 


i 


0 








300 


• 


• 


• 


i 


0 


i 




i-1 


i 


0 


2 


0 


i 








n 700 


• 


• 


• 




i 


i 


0 


• 


• 


• 










i-1 


0 


i 




0 


i 


1 
















i 


0 


i 




0 


i 


2 








400 


• 


• 


• 










0 


i 


i-1 
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mi 

i 

i 

• 

i 

i 

i 

900 i_ 

i 

i 

i 



m 2 n_ 

1 1 

2 1 

i-1 1 

1 2 

2 2 

i-1 2 

1 i-1 

2 i-1 

i-1 i-1 



1 

2 



1 

2 

1200 i 

1 

2 

i 



i 1 

i 1 

i 1 

i 2 

i 2 

i 2 

i i-2 

i i-2 

• • 

• 9 

i i-2 





mi 


m 2 


n 




1 


i 


i-1 




2 

• 


i 

• 


i-1 

« 




• 

i-1 


i 


i-1 




1 


i 


i 




2 


i 


i 




i 


i 


i 




1 


2 


i 




2 


2 


i 




i 


2 


i 


1500 


• 


• 


• 




1 


i-2 


i 




2 


i-2 


i 




i 


i-2 


i 


• 


1 


i-1 


i 




1 


i 


i 




2 


i-1 


i 




2 


i 


i 




i-2 


i-1 


i 




i-2 


i 


i 




i-1 


i-1 


i 
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mi m2 n_ 

i i i-1 

i-1 i i 

i i-1 i 

i i i 
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APPENDIX B 



CATEGORIES OF COMPUTATIONS FOR OPTIMAL EXPECTED 
RETURN AND OPTIMAL ALLOCATION POLICY 



Boundary Conditions 

1) W(0,0,n) = rn n=l,...,n 0 

2) W(mj,m 2 ,0) = -pm!-qm 2 m 1 =0, 1, . . . ,m® 

m 2 =0, 1, . . . ,m® 



Special Cases 
1) mi=0, m 2 >0, n>0 



W(0,m 2 ,n)= 



b 2 m 2 W(0,m 2 ,n-l)+a 2 nW(0 > in 2 -l > n) 

b 2 m 2 +a 2 n 



<j>*=0.0 



2) m!>0, m 2 = 0, n>0 



W(m x , 0,n)= 



b 1 miW(m 1 ,Q,n-l)+a 1 nW(m 1 -l > Q > n) 

bimj+ajn 



4>*=1 . 0 



General Case 
1) m x >0, m 2 >0, n>0 

Let A = {a x W(mi-1 ,m 2 , n)-a 2 W(m 1 ,m 2 -l , n ) } (bimj+b 2 m 2 +a 2 n) 

B = (a x -a 2 ) { (b 1 mi+b 2 m 2 )W(m! ,m 2 , n-l)+a 3 nW(nii ,m 2 -l , n ) } 

Then 

A > B => <(>* = 1.0 
A < B => <{>* = 0 . 0 
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And 

W(m 1 ,m 2 ,n) = [ cf>*a i nW(m x -1 , m 2 , n ) + ( 1-<J>* ) a 2 nW(mx , m 2 -l , n ) 

+ (b 1 mi+b 2 m 2 )\V(m 1 ,ra 2 , n-1) ] / [<j>*ain+( 1-4)* )a 2 n 



+bim 1 +b 2 m 2 ] 
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A 1 = 


2.000 


Bl * 


1.000 






A2 = 


1.000 


B 2 = 


1.000 






P = 


1.000 


Q = 


1.000 


R = 


1 . 





STATES 




EXPECTED 


PHI 


Ml 


M2 


N 


RETURN 


STAR 


1 


1 


1 


- 1.00 


1.00 


2 


1 


1 


- 2.20 


1.00 


1 


2 


1 


- 2.33 


1.00 


1 


1 


2 


0.56 


1.00 


2 


2 


1 


- 3.44 


1.00 


1 


2 


2 


- 1.00 


1.00 


2 


1 


2 


- 0.63 


1.00 


2 


2 


2 


- 2.22 


1.00 


3 


1 


1 


- 3.40 


1.00 


3 


2 


1 


- 4.56 


1.00 


3 


1 


2 


- 2.01 


1.00 


3 


2 


2 


- 3.52 


1.00 


1 


3 


1 


- 3.53 


1.00 


2 


3 


1 


- 4.58 


1.00 


3 


3 


1 


— 5.64 


1.00 


1 


3 


2 


- 2.54 


1.00 


2 


3 


2 


- 3.67 


1.00 


1 


1 


3 


2.08 


1.00 


2 


1 


3 


1 . 18 


1.00 


3 


1 


3 


- 0.10 


1.00 


1 


2 


3 


0.70 


1.00 


1 


3 


3 


- 1.02 


1.00 


2 


2 


3 


- 0.47 


1.00 


3 


3 


2 


- 4.86 


1.00 


2 


3 


3 


- 2.22 


1.00 


3 


2 


3 


- 1.86 


1.00 


3 


3 


3 


- 3 . 54 


1.00 


4 


1 


1 


— 4 .54 


1.00 


4 


2 


1 


- 5.64 


1.00 


4 


3 


1 


- 6.70 


1.00 


4 


1 


2 


- 3.42 


1.00 


4 


2 


2 


- 4.79 


1.00 


4 


3 


2 


- 6.03 


1.00 


4 


1 


3 


- 1.61 


1.00 


4 


2 


3 


- 3.32 


1.00 


4 


3 


3 


- 4.88 


1.00 


1 


4 


1 


- 4.63 


1.00 


2 


4 


1 


— 5 • 66 


1.00 


3 


4 


1 


- 6.70 


1.00 


4 


4 


1 


- 7.74 


1.00 


1 


4 


2 


- 3.90 


1.00 


2 


4 


2 


- 4.96 


1.00 


3 


4 


2 


- 6.07 


1.00 


4 


4 


2 


- 7.18 


1.00 


1 


4 


3 


- 2.71 


1.00 


2 


4 


3 


- 3.83 


1.00 


3 


4 


3 


- 5.04 


1.00 


1 


1 


4 


3.39 


1.00 


2 


1 


4 


2.79 


1.00 


3 


1 


4 


1.82 


1.00 


4 


1 


4 


0.50 


1.00 


1 


2 


4 


2.37 


1.00 


2 


2 


4 


1.42 


1.00 


3 


2 


4 


0.16 


1.00 


4 


2 


4 


- 1.33 


1.00 


1 


3 


4 


0.80 


1.00 


1 


4 


4 


- 1.04 


1.00 


2 


3 


4 


- 0.36 


1.00 


2 


4 


4 


- 2.24 


1.00 
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1 



A 1 = 11.000 
A 2 = 1.000 

P = 1.000 



81 = 1.000 
B 2 = 10.000 
Q = 1.000 



1.0 



R = 





STATES 
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Ml 


M 2 


N 


RETURN 


STAR 
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1 


1 


- 1.41 


1.00 
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1 


- 2.24 


1.00 
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2 


1 
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1.00 


1 
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-6.67 
17.27 
-3.78 
-6.03 
61.25 
3.45 
-5.03 
-4.78 
-5.75 
-6.74 
-7.75 
— 4 .48 
-5.31 
-6.26 
-7.2 5 
-4.14 
-4.79 
-5.62 
172.85 
159.37 
145.44 
131.18 
37.78 
32.22 
26.84 
21.69 
2.62 
-3. 53 
0.94 
-4.15 



0.0 

0.0 

1.00 

0.0 

1.00 

0.0 

0.0 

0.0 

0.0 

1.00 

0.0 

0.0 

1.00 

1.00 

1.00 

1.00 

1.00 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

1.00 

0.0 

0.0 

1.00 

0.0 

1.00 

1.00 

0.0 

0.0 

1.00 

0.0 

0.0 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

1.00 
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1 



A 1 = 11.000 
A2 = 1.000 

P= 1.000 



STATES 

Ml M2 N 



111 
2 1 1 

12 1 

1 1 2 

2 2 1 

1 2 2 

2 1 2 

2 2 2 

3 11 

3 2 1 

3 1 2 

3 2 2 

13 1 

2 3 1 

3 3 1 

13 2 

2 3 2 

1 1 3 

2 1 3 

3 1 3 

1 2 3 

13 3 

2 2 3 

3 3 2 

2 3 3 

3 2 3 

3 3 3 

4 1 1 

4 2 1 

4 3 1 

4 12 

4 2 2 

4 3 2 

4 13 

4 2 3 

4 3 3 

1 4 1 

2 4 1 

3 4 1 

4 4 1 

1 4 2 

2 4 2 

3 4 2 

4 4 2 

1 4 3 

2 4.3 

3 4 3 

1 1 4 

2 14 

3 14 

4 14 

12 4 

2 2 4 



B 1 = 1.000 

B2= 10.000 

Q= 1.000 



EXPECTED 

RETURN 



74.55 
56.87 
0.52 
363.52 
-1.35 
32.09 
313.71 
24.90 
39.75 
-3.14 
261.81 
16.06 
-3.69 
-4.67 
-5.67 
-1 . 52 
-2.93 
921.88 
832.07 

738.75 
143 .31 

11.26 

121.76 
-4.31 

7.76 
101.22 
4.48 
25.01 
-4.76 
-6.67 
210.80 
11 . 82 
-5.65 
644.00 
82.06 
1 . 47 
-4.78 
-5.75 
-6.74 
-7.75 
-4.44 
-5.30 
-6.25 
-7.25 
-3.37 
-4.43 
-5.46 
1736.61 
1606.68 
1472.85 
1336.28 
398.24 
350.21 



R= 1000.0 



PHI 

STAR 



0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
1.00 
1.00 
1.00 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
1.00 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
1 .00 
1.00 
1.00 
1.00 
1.00 
1.00 
1.00 
1.00 
0.0 
0.0 
1.00 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
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1 



A 1= 11.000 

A 2 = 1.000 

P= 1.000 



STATES 

Ml M2 N 




2 3 2 

113 

2 13 

3 13 

12 3 

13 3 

2 2 3 

3 3 2 

2 3 3 

3 2 3 

3 3 3 

All 
A 2 1 

4 3 1 

4 12 

A 2 2 

A 3 2 

A 1 3 

A 2 3 

4 3 3 

1 A 1 

2 A 1 

3 A 1 

A A 1 

1 A 2 

2 A 2 

3 A 2 

A A 2 

1 A 3 

2 A 3 

3 A 3 

1 1 A 

2 1 A 

3 1 A 

A 1 A 

12 4 

2 2 A 



8 1 = 1.000 
B 2= 10.000 
Q = 1.000 



EXPECTED 

RETURN 



762.05 
593.85 
31.77 
36A9.27 
21.99 
3A6.3A 
3158.71 
283.39 
A31.53 
13.19 
2 647 .77 
223.95 
- 2.88 
-A. 18 
-5. AA 
18.28 
12.73 
9229.86 
8338.01 
7411.63 
1456.78 
1A5.21 
1249. 9A 
7.67 
118.78 
1053. 3C 
94.81 
293.16 
5.97 
-6.62 
21A6. 15 
170.60 
3.23 
6A71.A7 
870.69 
73.56 

- A. 78 

- 5.75 
- 6. 74 

- 7.75 
-3.70 
-4.91 
- 6.10 
-7.20 

6.45 
3 . 3 A 
0 .48 
1737 A . 1A 
16079.75 
14746.99 
13367.29 
4003 . 55 
3531.45 



R= 10000.0 



PHI 

STAR 



0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

1.00 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

1.00 

1.00 

1.00 

1.00 

0.0 

0.0 

0.0 

1.00 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 



1 



A 1= 11.000 
A2 = 1.000 

P= 1.000 



STATES 

Ml M2 N 



1 1 1 

2 1 1 

1 2 1 

112 
2 2 1 

12 2 

2 12 

2 2 2 

3 11 

3 2 1 

3 12 

3 2 2 

1 3 1 

2 3 1 

3 3 1 

13 2 

2 3 2 

1 1 3 

2 13 

3 1 3 

12 3 

13 3 

2 2 3 

3 3 2 

2 3 3 

3 2 3 

3 3 3 

4 11 

4 2 1 

4 3 1 

4 12 

4 2 2 

4 3 2 

4 13 

4 2 3 

4 3 3 

1 4 1 

2 4 1 

3 4 1 

4 4 1 

14 2 

2 4 2 

3 4 2 

4 4 2 

1. 4 3 

2 4 3 

3 4 3 

1 1 4 

2 14 

3 14 

4 14 

1 2 4 

2 2 4 



81 = 1.000 
82= 10.000 
Q= 1.000 



EXPECTED 

RETURN 



7637.05 
5963 . 67 
344.27 
36506.70 
255.46 
3488.83 
31608.75 
2868.24 
4349.30 

176. 43 
26507.36 

2262.90 
6.88 
2.89 

-0.63 

217.91 

171.44 

92309.56 
83397.38 

74140.44 
14591.42 

1486. 16 
12531 .73 
129.85 

1230.90 
10574. 16 

1000.21 
2974.66 
113.23 
-3. 56 

21499.57 
1758.33 

94.32 
64746.18 
8756.98 
796.70 
-4.71 
-5.73 
- 6.74 
-7.75 
5.64 
2.32 
-0.67 
-3.31 
106.59 
84.23 
64.60 
173749.38 
160810.50 
147483. 19 
133697.25 
40056.69 
35343.85 



R= 100000.0 



PHI 

STAR 



0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

1.00 

1.00 

1.00 

1.00 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 
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OPTIMAL ALLOCATION OF FIRE FOR A STOCHASTIC 
LANCHESTER-TYPE ATTRITION PROCESS 



10 FORMAT ( 10X « 3 1 6 ) 

50 FORMAT (6 F 8 . 4 , F 1 0 . 4 ) 

75 FORMAT ( • 1 ' , 10X , • A 1 = • , F7. 3 , 5X , • 8 1= ' , F7 . 3 , / , 11 X , • A 2 
1F7.3,5X,'32=',F7.3,/,12X,'P=',F7.3,6X,'Q=',F7.3,7X 
2' R=' ,F10. 1 ,////) 

150 FORMAT ( 1 AX , • ST AT ES ' , 1 OX , ' E X PE CT ED • , 12 X , ' PH I ' ) 

250 FORMAT ( 1 OX, ' M 1 ' , 3X , ' M2 ' , AX , ' N • , 9X, ' RETURN ' » 1 3X , 
l'STAR' , //) 

350 FORMAT ( ' 1' I 

DIMENSION Will, 11, 11) 

COMMON Al f A2,bl,B2,P,QfRfW 
DO 1700 I NDEX = 1 , 500 
READ (5,50) A1,A2,B1,B2,P»0,R 
IF (Al. EQ. 999.0) GO TO 1800 
WRITE (6,75) A1,B1,A2»B2«P,Q,R 
WRITE (6,150) 

WRITE (6,250) 

NMAX= 10 

CALL CGMP (0,0,0) 

CALL COMP ( 1,0,0) 

CALL COMP (0,1,0) 

CALL COMP (0,0,1) 

CALL COMP (1,1,0) 

CALL COMP (0,1,1) 

CALL COMP (1,0,1) 

CALL CGMP (1,1,1) 

DO 100 N = 2 , NMA X 
1=0 
J=0 
K = 0 

CALL COMP ( N , J , K ) 

CALL CGMP ( I , N , K ) 

CALL CGMP (I,J,N) 

JMAX= N- 1 
DO 200 J= 1 , JMAX 
200 CALL COMP (N,J,K) 

DC 300 1=1, N 
300 CALL CGMP ( I ,N,K) 

KMAX= N- 1 
1=0 

DO AOO K= 1 , KMAX 
AOO CALL COMP ( I ,N,K) 

JMAX=N 

DO 500 J= 1 , J MAX 
500 CALL C 0 M P ( I , J , N ) 

J = 0 

KMAX=N-1 
DC 600 K= 1 , KMAX 
600 CALL CGMP ( N , J , K ) 

I MAX=N 

DO 700 I = 1,1 MAX 
700 CALL COMP ( I, J,N) 

JKAX=N-1 

• DC 900 K= 1 , KMAX 
DO 800 J= 1 , JMAX 
800 CALL COMP ( N, J , K ) 

900 CONTINUE 
KMAX=N- 1 

DO 1200 K= 1 , KMA X 
DO 1000 1=1, N 
IF (K.FO.KMAX) GO TO 1 
1000 CALL CGMP ( I,N,K) 

GO TO 1200 
1 I MAX=N- 1 

DO 1100 1 = 1, I MAX 
1100 CALL COMP ( I , N , K ) 

1200 CONTINUE 
' K = N 
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JMAX=N- 1 

DC 1500 J= 1 , JMAX 
DO 1300 1=1, N 
IF (J.EQ.JMAX) GO TO 2 
1300 CALL CCMP ( I , J,K) 

GO TO 1500 
2 I MAX* JMAX 

DO 1400 I = 1 t I MAX 
CALL COMP ( I, J,K) 

JMAX=N 

IF (I.EO.IMAX) GO TO 1600 
CALL COMP ( I, JMAX, K) 

1400 CONTINUE 
1500 CONTINUE 
1600 CONTINUE 
M=N-1 

CALL COMP ( N , N , M ) 

CALL COMP ( M» N» N ) 

CALL COMP ( N, M, N ) 

CALL CCMP ( N , N , N ) 

100 CONTINUE 
1700 CONTINUE 
1800 WRITE (6,350) 

STOP 

END 

SUBROUTINE COMP ( M 1 , M2 , N ) 

DIMENSION! W( 11, 11, 11) 

COMMON A1,A2,B1,B2,P,Q,R,W 
350 FORMAT ( 1 OX , I 2 , 2 ( 3X , I 2 ) , 7 X . F 1 0. 2 , 1 IX , F4 . 2 ) 

IF ( (Ml.EQ.O) .AND. (M2.GT.0) .AND. (N.GT.O ) ) GO TO 1 
IF ( (Ml.GT.O).AND. (M2. EQ.O) .AND. (N.GT.O ) ) GO TO 2 
IF ( (Ml .EQ.O ) .AND. ( M2. EQ.O) .AND. (N.GT.O ) ) GO TO 3 
IF (N.EQ.O) GO TO 4 

TEST1 = ( A1*W( Ml, M2 + 1,N+1)-A2*W(M1„ + 1,M2,N+1) ) * ( B1*M 1 + B2* 
1M2+A2*N ) 

TEST2=( Al— A2) *( ( B 1*M1+B2*M2 ) * W ( Ml +1 , M2+ 1 , N ) +A2*N# 

1 W ( M 1+ 1 , M2 » N+ 1 ) ) 

PHI =0 . 0 

IF (TEST1.GT.TEST2) PHI=1.0 

DENCM= PHI*Al#N+( 1.0-PHI )*A2*N +B 1*M1+B2*M2 
W(M1+1,M2+1,N+1 )=(PHI*A1*N*W(M1 ,M2+l,N+l)+( 1.0-PHI )*A2 
1*N*W(M1+1,M2,N+1 )+(61*Ml+62*M2)*W(Ml+l,M2+l ,N) )/DENOM 
WRITE ( 6,350) Ml , M2 , N, W ( M1+ 1 , M2+ 1 , N+l > , PHI 
RETURN 

1 W ( 1 »M2+1 , N+l )=(B2*M2*W( 1 , M2+ 1 , N ) +A2*N* W ( 1, M2, N+l) )/ 

1( B2*M2+A2*N) 

RETURN 

2 W ( M 1+ 1 , 1 » N + 1 ) = ( 3 1 * M 1 * W ( M 1 + 1 » 1 , N ) +A1*N* W ( Ml , 1,N+1 ) ) / 

1 (B1*M1+A1*N) 

RETURN 

3 W( 1, 1,N+1 )=R*N 
RETURN 

4 W ( M1+ 1 , M2+ 1 , 1 ) =- ( P*M1+Q*M2 ) 

RETURN 

END 
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